Electronic device and method for controlling biosensor linked with display by using same

ABSTRACT

Various examples of the present invention relate to a method for controlling a biosensor linked with a display, the method comprising: acquiring an input of a user on the basis of a first region corresponding to the biosensor and a second region which corresponds to a touch sensor and is adjacent to at least a part of the first region; confirming an input shape corresponding to the input of the user; and acquiring, through a control of the biosensor, bio-information corresponding to the input of the user when the confirmed input shape satisfies a predetermined condition. Other embodiments are also possible.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.16/481,546 filed on Jul. 29, 2019 which claims priority of NationalPhase Entry of PCT International Application No. PCT/KR2018/001281,which was filed on Jan. 30, 2018, and claims priority to Korean PatentApplication No. 10-2017-0013731 which was filed on Jan. 31, 2017, thecontents of which are incorporated herein by reference.

TECHNICAL FIELD

Various embodiments of the disclosure relate to a method for controllinga biosensor associated with a display of an electronic device.

BACKGROUND ART

With the diverse usages of portable electronic devices, there have beenincreasing concerns about security functions of the portable electronicdevices. A portable electronic device may be configured to release alocking function based on a password or a pattern. Recently, a portableelectronic device may include a built-in biosensor (e.g., fingerprintsensor or iris sensor), and it may be configured to release a lockingfunction using the biosensor. With the increasing concern aboutsecurity, a security method based on a biosensor that is difficult to becopied may be used in diverse manners.

A portable electronic device may include a fingerprint sensor that is akind of biosensors, and it may recognize a user's fingerprint throughthe fingerprint sensor. The portable electronic device may perform userauthentication using the fingerprint sensor.

DISCLOSURE OF INVENTION Technical Problem

A role of a portable electronic device as a display has becomeimportant, and there is a trend that the size of such a display isgradually increased. Accordingly, it may be considered that a biosensor(e.g., fingerprint sensor), which has been provided separately from adisplay on a portable electronic device, is built in the portableelectronic device. A portable electronic device may have a built-infingerprint sensor, and a part of a display region of a display may beconfigured as a fingerprint sensing region for recognizing thefingerprint. In the portable electronic device, the fingerprint sensorcorresponding to the fingerprint sensing region may be built as aconstituent part constituting the display. The fingerprint sensor mayoperate in association with the display. For example, the fingerprintsensor may be built in a partial region of the display, and afingerprint recognition region may be formed based on the built-infingerprint sensor. The portable electronic device may perform userauthentication through recognition of a user's fingerprint inputcorresponding to the fingerprint recognition region.

Because the fingerprint recognition region is formed on the partialregion of the display, it may be difficult to detect the user'sfingerprint input on a region of the portable electronic deviceexcluding the fingerprint recognition region.

Various embodiments of the disclosure are to notify a user that afingerprint input error has occurred with respect to a user'sfingerprint input onto a region excluding a fingerprint recognitionregion and to provide a guide to a user for an accurate fingerprintinput.

Solution to Problem

According to various embodiments of the disclosure, an electronic devicemay include a biosensor; a processor; a display panel including a firstregion corresponding to the biosensor and a touch sensor including asecond region formed at least partly adjacent to at least a part of thefirst region; and one or more control circuits configured to control thetouch sensor, wherein the processor is configured to acquire a user'sinput based on the first region and the second region, identify an inputshape corresponding to the user's input, and acquire biometricinformation corresponding to the user's input through a control of thebiosensor if the identified input shape satisfies a designatedcondition.

According to various embodiments of the disclosure, a method forcontrolling a biosensor associated with a display may include acquiringa user's input based on a first region corresponding to the biosensorand a second region corresponding to a touch sensor and adjacent to atleast a part of the first region; identifying an input shapecorresponding to the user's input; and acquiring biometric informationcorresponding to the user's input through a control of the biosensor ifthe identified input shape satisfies a designated condition.

Advantageous Effects of Invention

According to the various embodiments of the disclosure, it is possibleto determine a partial region of a display of an electronic device as afingerprint sensing region and to recognize a user's fingerprint inputbased on the fingerprint sensing region. According to the variousembodiments of the disclosure, it is possible to form a fingerprintrecognition region for recognizing the user's fingerprint and afingerprint error region adjacent to the fingerprint recognition regionand to recognize the user's fingerprint based on the fingerprintrecognition region and the fingerprint error region. According to thevarious embodiments of the disclosure, it is possible to notify a userthat a fingerprint input error has occurred if the user's input isdetected in the fingerprint error region. According to the variousembodiments of the disclosure, it is possible to guide the fingerprintrecognition region so that the user can conveniently perform userauthentication on the display. According to the various embodiments ofthe disclosure, user convenience for the user authentication based onthe fingerprint sensor can be increased.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an electronic device in a networkenvironment according various embodiments of the disclosure;

FIG. 2 is a block diagram of an electronic device according to variousembodiments of the disclosure;

FIG. 3 is a block diagram of a program module according to variousembodiment of the disclosure;

FIG. 4 is a diagram illustrating a structure in which a display isdeployed on a front side of an electronic device according to variousembodiments of the disclosure;

FIG. 5 is a diagram illustrating a structure in which a fingerprintsensor is built in a display of an electronic device according tovarious embodiments of the disclosure;

FIG. 6A is a block diagram of constituent parts of an electronic deviceaccording to various embodiments of the disclosure, and FIG. 6B is ablock diagram of constituent parts of an electronic device according tovarious embodiments of the disclosure;

FIG. 7 is a diagram illustrating the structure of main constituent partsof an electronic device according to various embodiments of thedisclosure;

FIG. 8 is a flowchart explaining operations of main constituent parts inthe case where a fingerprint input is detected in a state where adisplay is turned off according to various embodiments of thedisclosure;

FIG. 9 is a flowchart explaining operations of main constituent parts inthe case where a fingerprint input is detected in a state where adisplay is turned on according to various embodiments of the disclosure;

FIG. 10 is a flowchart explaining an operation of detecting afingerprint input based on a touch pressure in a state where a displayis turned on according to various embodiments of the disclosure;

FIG. 11 is a flowchart explaining a method for recognizing a fingerprintusing a fingerprint sensor associated with a display according tovarious embodiments of the disclosure;

FIG. 12 is a diagram illustrating a fingerprint recognition regionformed corresponding to a partial region of a display according tovarious embodiments of the disclosure;

FIG. 13 is a diagram illustrating a process of detecting a user's inputbased on a fingerprint recognition region according to variousembodiments of the disclosure;

FIG. 14 is a diagram illustrating a process of recognizing a user'sfingerprint according to various embodiments of the disclosure;

FIG. 15 is a diagram illustrating a fingerprint recognition region and afingerprint error region according to various embodiments of thedisclosure; and

FIG. 16 is a diagram illustrating a process of recognizing a fingerprintbased on a fingerprint recognition region and a fingerprint error regionaccording to various embodiments of the disclosure.

MODE FOR THE INVENTION

Hereinafter, the present disclosure is described with reference to theaccompanying drawings. Although specific embodiments are illustrated inthe drawings and related detailed descriptions are discussed in thepresent specification, the present disclosure may have variousmodifications and several embodiments. However, various embodiments ofthe present disclosure are not limited to a specific implementation formand it should be understood that the present disclosure includes allchanges and/or equivalents and substitutes included in the spirit andscope of various embodiments of the present disclosure. In connectionwith descriptions of the drawings, similar components are designated bythe same reference numeral.

In various embodiments of the present disclosure, the terms such as“include”, “have”, “may include” or “may have” may be construed todenote a certain characteristic, number, step, operation, constituentelement, component or a combination thereof, but may not be construed toexclude the existence of or a possibility of addition of one or moreother characteristics, numbers, steps, operations, constituent elements,components or combinations thereof.

In various embodiments of the present disclosure, the expression “or” or“at least one of A or/and B” includes any or all of combinations ofwords listed together. For example, the expression “A or B” or “at leastA or/and B” may include A, may include B, or may include both A and B.

The expression “1”, “2”, “first”, or “second” used in variousembodiments of the present disclosure may modify various components ofthe various embodiments but does not limit the corresponding components.For example, the above expressions do not limit the sequence and/orimportance of the components. The expressions may be used fordistinguishing one component from other components. For example, a firstuser device and a second user device indicate different user devicesalthough both of them are user devices. For example, without departingfrom the scope of the present disclosure, a first structural element maybe referred to as a second structural element. Similarly, the secondstructural element also may be referred to as the first structuralelement.

When it is stated that a component is “(operatively or communicatively)coupled to” or “connected to” another component, the component may bedirectly coupled or connected to another component or a new componentmay exist between the component and another component. In contrast, whenit is stated that a component is “directly coupled to” or “directlyconnected to” another component, a new component does not exist betweenthe component and another component.

In the present disclosure, the expression “configured (or set) to do”may be used to be interchangeable with, for example, “suitable fordoing,” “having the capacity to do,” “designed to do,” “adapted to do,”“made to do,” or “capable of doing.” The expression “configured (or set)to do” may not be used to refer to only something in hardware for whichit is “specifically designed to do.” Instead, the expression “a deviceconfigured to do” may indicate that the device is “capable of doing”something with other devices or parts. For example, the expression “aprocessor configured (or set) to do A, B and C” may refer to a dedicatedprocessor (e.g., an embedded processor) or a generic-purpose processor(e.g., CPU or application processor) that may execute one or moresoftware programs stored in a memory device to perform correspondingfunctions.

It should be appreciated that various embodiments of the presentdisclosure and the terms used therein are not intended to limit thetechnological features set forth herein to particular embodiments andinclude various changes, equivalents, or replacements for acorresponding embodiment. Unless otherwise defined herein, all termsincluding technical or scientific terms used herein have the samemeanings as commonly understood by those skilled in the art to which thepresent disclosure belongs. It will be further understood that terms,such as those defined in commonly used dictionaries, should beinterpreted as having a meaning that is consistent with their meaning inthe context of the specification and relevant art and should not beinterpreted in an idealized or overly formal sense unless expressly sodefined herein.

An electronic device according to various embodiments of the presentinvention may be a device including an antenna. For example, theelectronic device may be one or more of the following: a smart phone, atablet Personal Computer (PC), a mobile phone, a video phone, an e-bookreader, a desktop PC, a laptop PC, a netbook computer, a PersonalDigital Assistant (PDA), Portable Multimedia Player (PMP), MP3 player, amobile medical application, a camera, and a wearable device (forexample, a Head-Mounted-Device (HMD), such as electronic glasses,electronic clothes, an electronic bracelet, an electronic necklace, anelectronic appcessary, an electronic tattoo, and a smart watch).

According to some embodiments, the electronic device may be a smart homeappliance having an antenna. The smart home appliance may include atleast one of the following: a Television (TV), a Digital Video Disk(DVD) player, an audio player, an air conditioner, a cleaner, an oven, amicrowave oven, a washing machine, an air purifier, a set-top box, a TVbox (for example, Samsung HomeSync™, Apple TV™, or Google TV™), gameconsoles, an electronic dictionary, an electronic key, a camcorder, andan electronic frame.

According to some embodiments, the electronic device may include atleast one of the following: various types of medical devices (forexample, Magnetic Resonance Angiography (MRA), Magnetic ResonanceImaging (MRI), Computed Tomography (CT), a scanner, an ultrasonic deviceand the like), a navigation device, a Global Positioning System (GPS)receiver, an Event Data Recorder (EDR), a Flight Data Recorder (FDR), avehicle infotainment device, electronic equipment for a ship (forexample, a navigation device for ship, a gyro compass and the like),avionics, a security device, a head unit for a vehicle, an industrial orhome robot, an Automatic Teller Machine (ATM) of financial institutions,and a Point Of Sale (POS) device of shops.

According to some embodiments, the electronic device may include atleast one of the following: furniture or a part of a building/structure,an electronic board, an electronic signature receiving device, aprojector, and various types of measuring devices (for example, a watermeter, an electricity meter, a gas meter, a radio wave meter and thelike), which are equipped with an antenna. The electronic deviceaccording to various embodiments of the present invention may also be acombination of the devices listed above. Further, the electronic deviceaccording to various embodiments of the present disclosure may be aflexible device. It is apparent to those skilled in the art that theelectronic device according to various embodiments of the presentinvention is not limited to the above described devices.

Hereinafter, an electronic device according to various embodiments willbe discussed with reference to the accompanying drawings. The term seskilled in the art that the electronic device according to variousembodiments of the present meter and the e (e.g., an artificialintelligence electronic device) using an electronic device.

FIG. 1 illustrates a network environment 100 including an electronicdevice 101 according to various embodiments of the present disclosure.

Referring to FIG. 1, the electronic device 101, 102, 104 may connect tothe server 106 via the network 162 or short-wireless communication 164.

The electronic device 101 may include a bus 110, a processor 120, amemory 130, an input/output interface 150, a display 160, and acommunication interface 170. According to some embodiments, at least oneof the above described components may be omitted from the electronicdevice 101 or another component may be further included in theelectronic device 101. The bus 110 may be a circuit connecting the abovedescribed components 120, 130, and 150˜170 and transmittingcommunications (e.g., control messages and/or data) between the abovedescribed components. The processor 120 is capable of including one ormore of the following: a central processing unit (CPU), an applicationprocessor (AP), and a communication processor (CP). The processor 120 iscapable of controlling at least one of other components of theelectronic device 101 and/or processing data or operations related tocommunication.

The memory 130 is capable of including volatile memory and/ornon-volatile memory. The memory 130 is capable of storing data orcommands related to at least one of other components of the electronicdevice 101. According to an embodiment, the memory 130 is capable ofstoring software and/or a program module 140. For example, the programmodule 140 is capable of including a kernel 141, middleware 143,application programming interface (API) 145, application programs (orapplications) 147, etc. The kernel 141, middleware 143 or at least partof the API 145 may be called an operating system (OS). The kernel 141 iscapable of controlling or managing system resources (e.g., the bus 110,processor 120, memory 130, etc.) used to execute operations or functionsof other programs (e.g., the middleware 143, API 145, and applicationprograms 147). The kernel 141 provides an interface capable of allowingthe middleware 143, API 145, and application programs 147 to access andcontrol/manage the individual components of the electronic device 101.

The middleware 143 is capable of mediating between the API 145 orapplication programs 147 and the kernel 141 so that the API 145 or theapplication programs 147 can communicate with the kernel 141 andexchange data therewith. The middleware 143 is capable of processing oneor more task requests received from the application programs 147according to the priority. For example, the middleware 143 is capable ofassigning a priority for use of system resources of the electronicdevice 101 (e.g., the bus 110, processor 120, memory 130, etc.) to atleast one of the application programs 147. For example, the middleware143 processes one or more task requests according to a priority assignedto at least one application program, thereby performing scheduling orload balancing for the task requests. The API 145 refers to an interfaceconfigured to allow the application programs 147 to control functionsprovided by the kernel 141 or the middleware 143. The API 145 is capableof including at least one interface or function (e.g., instructions) forfile control, window control, image process, text control, or the like.The input/output interface 150 is capable of transferring instructionsor data, received from the user or external devices, to one or morecomponents of the electronic device 101. The input/output interface 150is capable of outputting instructions or data, received from one or morecomponents of the electronic device 101, to the user or externaldevices.

The display 160 is capable of including a Liquid Crystal Display (LCD),a flexible display, a transparent display, a Light Emitting Diode (LED)display, an Organic Light Emitting Diode (OLED) display,Micro-Electro-Mechanical Systems (MEMS) display, an electronic paperdisplay, etc. The display 160 is capable of displaying various types ofcontent (e.g., texts, images, videos, icons, symbols, etc.). The display160 may also be implemented with a touch screen. In this case, thedisplay 160 is capable of receiving touches, gestures, proximity inputsor hovering inputs, via a stylus pen, or a user's body.

The communication interface 170 is capable of establishing communicationbetween the electronic device 101 and an external device (e.g., a firstexternal device 102, a second electronic device 104, or a server 106).For example, the communication interface 170 is capable of communicatingwith an external device (e.g., a second external device 104 or a server106) connected to the network 162 via wired or wireless communication.

Wireless communication may employ, as cellular communication protocol,at least one of the following: long-term evolution (LTE), LTE Advance(LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA),universal mobile telecommunications system (UMTS), Wireless Broadband(WiBro), and Global System for Mobile Communication (GSM). Wirelesscommunication may also include short-wireless communication 164.Short-wireless communication 164 may include at least one of thefollowing: wireless fidelity (WiFi), LiFi(light fidelity), Bluetooth(BT), near field communication (NFC), Magnetic Secure Transmission(MST), and Global Navigation Satellite System (GNSS). The GNSS mayinclude at least one of the following: Global Positioning System (GPS),Global Navigation Satellite System (Glonass), Beidou NavigationSatellite System (hereinafter called ‘Beidou”), Galileo, the Europeanglobal satellite-based navigation system, according to GNSS using areas,bandwidths, etc. In the present disclosure, “GPS” and “GNSS” may be usedinterchangeably. Wired communication may include at least one of thefollowing: universal serial bus (USB), high definition multimediainterface (HDMI), recommended standard 232 (RS-232), and plain oldtelephone service (POTS). The network 162 may include at least one ofthe following: a telecommunications network, e.g., a computer network(e.g., LAN or WAN), the Internet, and a telephone network.

The first and second external electronic devices 102 and 104 are eachidentical to or different from the electronic device 101, in terms oftype. According to an embodiment, the server 106 is capable of includinga group of one or more servers. According to various embodiments, partor all of the operations executed on the electronic device 101 may beexecuted on another electronic device or a plurality of other electronicdevices (e.g., electronic devices 102 and 104 or a server 106).According to an embodiment, when the electronic device needs to performa function or service automatically or according to a request, it doesnot perform the function or service, but is capable of additionallyrequesting at least part of the function related to the function orservice from other electronic device (e.g., electronic devices 102 and104 or a server 106). The other electronic device (e.g., electronicdevices 102 and 104 or a server 106) is capable of executing therequested function or additional functions, and transmitting the resultto the electronic device 101. The electronic device 101 processes thereceived result, or further proceeds with additional processes, toprovide the requested function or service. To this end, the electronicdevice 101 may employ cloud computing, distributed computing, orclient-server computing technology.

FIG. 2 is a detailed block diagram showing a configuration of anelectronic device 201 according to various embodiments. For example, theelectronic device 201 is capable of including part or all of thecomponents in the electronic device 101 shown in FIG. 1. The electronicdevice 201 is capable of including one or more processors 210 (e.g.,Application Processors (APs)), a communication module 220, a SubscriberIdentification Module (SIM) 224, a memory 230, a sensor module 240, aninput device 250, a display 260, an interface 270, an audio module 280,a camera module 291, a power management module 295, a battery 296, anindicator 297, and a motor 298. The processor 210 is capable of driving,for example, an operating system or an application program to control aplurality of hardware or software components connected to the processor210, processing various data, and performing operations. The processor210 may be implemented as, for example, a System on Chip (SoC).According to an embodiment, the processor 210 may further include agraphic processing unit (GPU) and/or an image signal processor. Theprocessor 210 may also include at least part of the components shown inFIG. 2, e.g., a cellular module 221. The processor 210 is capable ofloading commands or data received from at least one of other components(e.g., a non-volatile memory) on a volatile memory, processing theloaded commands or data. The processor 210 is capable of storing variousdata in a non-volatile memory.

The communication module 220 may include the same or similarconfigurations as the communication interface 170 shown in FIG. 1. Forexample, the communication module 170 is capable of including a cellularmodule 221, WiFi module 223, Bluetooth (BT) module 225, GNSS module 227(e.g., a GPS module, Glonass module, Beidou module or Galileo module),NFC module 228, and Radio Frequency (RF) module 229. The cellular module221 is capable of providing a voice call, a video call, an SMS service,an Internet service, etc., through a communication network, for example.According to an embodiment, the cellular module 221 is capable ofidentifying and authenticating an electronic device 201 in acommunication network by using a subscriber identification module (SIM)224 (e.g., a SIM card). According to an embodiment, the cellular module221 is capable of performing at least part of the functions provided bythe processor 210. According to an embodiment, the cellular module 221is also capable of including a communication processor (CP). Each of theWiFi module 223, the BT module 225, the GNSS module 227, and the NFCmodule 228 is capable of including a processor for processing datatransmitted or received through the corresponding module. According toembodiments, at least part of the cellular module 221, WiFi module 223,BT module 225, GNSS to module 227, and NFC module 228 (e.g., two or moremodules) may be included in one integrated chip (IC) or one IC package.The RF module 229 is capable of transmission/reception of communicationsignals, e.g., RF signals. The RF module 229 is capable of including atransceiver, a power amp module (PAM), a frequency filter, a low noiseamplifier (LNA), an antenna, etc. According to another embodiment, atleast one of the following modules: cellular module 221, WiFi module223, BT module 225, GNSS module 227, and NFC module 228 is capable oftransmission/reception of RF signals through a separate RF module. TheSIM module 224 is capable of including a card including a subscriberidentification module (SIM) and/or an embodied SIM. The SIM module 224is also capable of containing unique identification information, e.g.,integrated circuit card identifier (ICCID), or subscriber information,e.g., international mobile subscriber identity (IMSI).

The memory 230 (e.g., memory 130 shown in FIG. 1) is capable ofincluding a built-in memory 232 or an external memory 234. The built-inmemory 232 is capable of including at least one of the following: avolatile memory, e.g., a dynamic RAM (DRAM), a static RAM (SRAM), asynchronous dynamic RAM (SDRAM), etc.; and a non-volatile memory, e.g.,a one-time programmable ROM (OTPROM), a programmable ROM (PROM), anerasable and programmable ROM (EPROM), an electrically erasable andprogrammable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory(e.g., a NAND flash memory, an NOR flash memory, etc.), a hard drive, asolid state drive (SSD), etc. The external memory 234 is also capable ofincluding a flash drive, e.g., a compact flash (CF), a secure digital(SD), a micro secure digital (Micro-SD), a mini secure digital(Mini-SD), an extreme digital (xD), a multi-media card (MMC), a memorystick, etc. The external memory 234 is capable of being connected to theelectronic device 201, functionally and/or physically, through variousinterfaces.

The sensor module 240 is capable of measuring/detecting a physicalquantity or an operation state of the electronic device 201, andconverting the measured or detected information into an electronicsignal. The sensor module 240 is capable of including at least one ofthe following: a gesture sensor 240A, a gyro sensor 240B, an atmosphericpressure sensor 240C, a magnetic sensor 240D, an acceleration sensor240E, a grip sensor 240F, a proximity sensor 240G, a color sensor 240H(e.g., a red, green and blue (RGB) sensor), a biometric sensor 240I, atemperature/humidity sensor 240J, an illuminance sensor 240K, aultraviolet (UV) sensor 240M and a finger print sensor 240N.Additionally or alternatively, the sensor module 240 is capable offurther including an E-nose sensor, an electromyography (EMG) sensor, anelectroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, aninfrared (IR) sensor and/or an iris sensor. The sensor module 240 iscapable of further including a control circuit for controlling one ormore sensors included therein. In embodiments, the electronic device 201is capable of including a processor, configured as part of the processor210 or a separate component, for controlling the sensor module 240. Inthis case, while the processor 210 is operating in sleep mode, theprocessor is capable of controlling the sensor module 240.

The input device 250 is capable of including a touch panel 252, a(digital) pen sensor 254, a key 256, or an ultrasonic input unit 258.The touch panel 252 may be implemented with at least one of thefollowing: a capacitive touch system, a resistive touch system, aninfrared touch system, and an ultrasonic touch system. The touch panel252 may further include a control circuit. The touch panel 252 may alsofurther include a tactile layer to provide a tactile response to theuser. The (digital) pen sensor 254 may be implemented with a part of thetouch panel or with a separate recognition sheet. The key 256 mayinclude a physical button, an optical key, or a keypad. The ultrasonicinput unit 258 is capable of detecting ultrasonic waves, created in aninput tool, through a microphone 288, and identifying data correspondingto the detected ultrasonic waves.

The display 260 (e.g., the display 160 shown in FIG. 1) is capable ofincluding a panel 262, a hologram unit 264, or a projector 266. Thepanel 262 may include the same or similar configurations as the display160 shown in FIG. 1. The panel 262 may be implemented to be flexible,transparent, or wearable. The panel 262 may also be incorporated intoone module together with the touch panel 252. The hologram unit 264 iscapable of showing a stereoscopic image in the air by using lightinterference. The projector 266 is capable of displaying an image byprojecting light onto a screen. The screen may be located inside oroutside of the electronic device 201. According to an embodiment, adisplay 260 may include a fingerprint sensor 240N to recognize a user'sfingerprint. The display 260 may include the fingerprint sensor 240Ncorresponding to a partial region of a panel 262. The display 260 mayconfigure the partial region of the display 260 as a fingerprint sensingregion, and it may recognize the user's fingerprint based on thefingerprint sensing region. The fingerprint sensor 240N may beintegrally implemented with a touch panel 252, or it may be implementedby one or more sensors separately from the touch panel 252.

The interface 270 is capable of including a high-definition multimediainterface (HDMI) 272, a universal serial bus (USB) 274, an opticalinterface 276, or a D-subminiature (D-sub) 278.

The interface 270 may be included in the communication interface 170shown in FIG. 1. Additionally or alternatively, the interface 270 iscapable of including a mobile high-definition link (MHL) interface, asecure digital (SD) card/multimedia card (MMC) interface, or an infrareddata association (IrDA) standard interface.

The audio module 280 is capable of providing bidirectional conversionbetween a sound and an electronic signal. At least part of thecomponents in the audio module 280 may be included in the input/outputinterface 150 shown in FIG. 1. The audio module 280 is capable ofprocessing sound information input or output through a speaker 282, areceiver 284, earphones 286, microphone 288, etc. The camera module 291refers to a device capable of taking both still and moving images.According to an embodiment, the camera module 291 is capable ofincluding one or more image sensors (e.g., a front image sensor or arear image sensor), a lens, an image signal processor (ISP), a flash(e.g., an LED or xenon lamp), etc. The power management module 295 iscapable of managing power of the electronic device 201. According to anembodiment, the power management module 295 is capable of including apower management integrated circuit (PMIC), a charger IC, or a batteryor fuel gauge. The PMIC may employ wired charging and/or wirelesscharging methods. Examples of the wireless charging method are magneticresonance charging, magnetic induction charging, and electromagneticcharging. To this end, the PIMC may further include an additionalcircuit for wireless charging, such as a coil loop, a resonance circuit,a rectifier, etc. The battery gauge is capable of measuring the residualcapacity, charge in voltage, current, or temperature of the battery 296.The battery 296 takes the form of either a rechargeable battery or asolar battery.

The indicator 297 is capable of displaying a specific status of theelectronic device 201 or a part thereof (e.g., the processor 210), e.g.,a boot-up status, a message status, a charging status, etc. The motor298 is capable of converting an electrical signal into mechanicalvibrations, such as, a vibration effect, a haptic effect, etc. Althoughnot shown, the electronic device 201 is capable of further including aprocessing unit (e.g., GPU) for supporting a mobile TV. The processingunit for supporting a mobile TV is capable of processing media datapursuant to standards, e.g., digital multimedia broadcasting (DMB),digital video broadcasting (DVB), or mediaFlo™, etc.

FIG. 3 is a block diagram of a programming module according to variousembodiments. According to an embodiment, the program module 310 (e.g.,program module 140 shown in FIG. 1) is capable of including an operationsystem (OS) for controlling resources related to the electronic device(e.g., electronic device 101) and/or various applications (e.g.,application programs 147 shown in FIG. 1) running on the OS. The OS maybe Android, iOS, Windows, Symbian, Tizen, Bada, etc. The program module310 is capable of including a kernel 320, middleware 330, applicationprogramming interface (API) 360 and/or applications 370. At least partof the program module 310 may be preloaded on the electronic device ordownloaded from a server (e.g., an electronic device 102 or 104, server106, etc.).

The kernel 320 (for example, kernel 141) may include a system resourcemanager 321 and/or a device driver 323. The system resource manager 321may include, for example, a process manager, a memory manager, and afile system manager. The system resource manager 321 may perform asystem resource control, allocation, and recall. The device driver 323may include, for to example, a display driver, a camera driver, aBluetooth driver, a shared memory driver, a USB driver, a keypad driver,a WiFi driver, and an audio driver. Further, according to an embodiment,the device driver 323 may include an Inter-Process Communication (IPC)driver. The middleware 330 may provide a function required in common bythe applications 370. Further, the middleware 330 may provide a functionthrough the API 360 to allow the applications 370 to efficiently uselimited system resources within the electronic device. According to anembodiment, the middleware 330 (for example, the middleware 143) mayinclude at least one of a runtime library 335, an application manager341, a window manager 342, a multimedia manager 343, a resource manager344, a power manager 345, a database manager 346, a package manager 347,a connection manager 348, a notification manager 349, a location manager350, a graphic manager 351, and a security manager 352.

The runtime library 335 may include, for example, a library module usedby a complier to add a new function through a programming language whilethe applications 370 are executed. According to an embodiment, theruntime library 335 executes input and output, management of a memory, afunction associated with an arithmetic function and the like. Theapplication manager 341 may manage, for example, a life cycle of atleast one of the applications 370. The window manager 342 may manage GUIresources used on the screen. The multimedia manager 343 may detect aformat required for reproducing various media files and perform anencoding or a decoding of a media file by using a codec suitable for thecorresponding format. The resource manager 344 manages resources such asa source code, a memory, or a storage space of at least one of theapplications 370. A power manager 345 may manage, for example, a batterycapacity, a temperature, or a power, and it may determine or providepower information required for the operation of the electronic deviceusing the corresponding information as described above. The powermanager 345 may operate together with a Basic Input/Output System(BIOS). The database manager 346 may manage generation, search, andchange of a database to be used by at least one of the applications 370.The package manager 347 may manage an installation or an update of anapplication distributed in a form of a package file.

The connection manager 348 may manage, for example, a wirelessconnection such as WiFi or Bluetooth. The notification manager 349 maydisplay or notify a user of an event such as an arrival message, anappointment, a proximity alarm or the like, in a manner that does notdisturb the user. The location manager 350 may manage locationinformation of the electronic device. The graphic manager 351 may managea graphic effect provided to the user or a user interface related to thegraphic effect. The security manager 352 provides a general securityfunction required for a system security or a user authentication.According to an embodiment, when the electronic device (for example, theelectronic device 101) has a call function, the middleware 330 mayfurther include a telephony manager for managing a voice of theelectronic device or a video call function. The middleware 330 iscapable of including modules configuring various combinations offunctions of the above described components. The middleware 330 iscapable of providing modules specialized according to types of operationsystems to provide distinct functions. The middleware 330 may beadaptively configured in such a way as to remove part of the existingcomponents or to include new components. The API 360 (for example, API145) may be a set of API programming functions, and may be provided witha different configuration according to an operating system. For example,in Android or iOS, a single API set may be provided for each platform.In Tizen, two or more API sets may be provided.

The applications 370 (e.g., application programs 147) may include one ormore applications for performing various functions, e.g., home 371,diary 372, SMS/MMS 373, instant message (IM) 374, browser 375, camera376, alarm 377, contact 378, voice dial 379, email 380, calendar 381,media player 382, album 383, clock 384, health care (e.g., anapplication for measuring amount of exercise, blood sugar level, etc.),and environment information (e.g., an application for providingatmospheric pressure, humidity, temperature, etc.). According to anembodiment, the applications 370 are capable of including an applicationfor supporting information exchange between an electronic device (e.g.,electronic device 101) and an external device (e.g., electronic devices102 and 104), which is hereafter called ‘information exchangeapplication’). The information exchange application is capable ofincluding a notification relay application for relaying specificinformation to external devices or a device management application formanaging external devices. For example, the notification relayapplication is capable of including a function for relaying notificationinformation, created in other applications of the electronic device(e.g., SMS/MMS application, email application, health care application,environment information application, etc.) to external devices (e.g.,electronic devices 102 and 104). In addition, the notification relayapplication is capable of receiving notification information fromexternal devices to provide the received information to the user. Thedevice management application is capable of managing (e.g., installing,removing or updating) at least one function of an external device (e.g.,electronic devices 102 and 104) communicating with the electronicdevice. Examples of the function are a function of turning-on/off theexternal device or part of the external device, a function ofcontrolling the brightness (or resolution) of the display, applicationsrunning on the external device, services provided by the externaldevice, etc. Examples of the services are a call service, messagingservice, etc. According to an embodiment, the applications 370 arecapable of including an application (e.g., a health care application ofa mobile medical device, etc.) specified attributes of an externaldevice (e.g., electronic devices 102 and 104). According to anembodiment, the applications 370 are capable of including applicationsreceived from an external device (e.g., a server 106, electronic devices102 and 104). According to an embodiment, the applications 370 arecapable of including a preloaded application or third party applicationsthat can be downloaded from a server. It should be understood that thecomponents of the program module 310 may be called different namesaccording to types of operating systems. According to variousembodiments, at least part of the program module 310 can be implementedwith software, firmware, hardware, or any combination of two or more ofthem. At least part of the program module 310 can be implemented (e.g.,executed) by a processor (e.g., processor 210). At least part of theprograming module 310 may include modules, programs, routines, sets ofinstructions or processes, etc., in order to perform one or morefunctions.

FIG. 4 is a diagram illustrating a structure in which a display isdeployed on a front side of an electronic device according to variousembodiments of the disclosure.

An electronic device 400 (e.g., electronic device 101 of FIG. 1)according to various embodiments may include a display 410 (e.g.,display 160 of FIG. 1) deployed on the front side of the electronicdevice 400, and a fingerprint sensor 420 (e.g., biosensor 240I of FIG.2) built corresponding to a partial region of the display 410. Thedisplay 410 may include the fingerprint sensor 420 based on the partialregion thereof.

The front side of the electronic device 400 according to variousembodiments may be composed of the display 410, and the fingerprintsensor 420 may be configured to be built on a lower portion of thedisplay 410. In the electronic device 400 according to variousembodiments, the fingerprint sensor 420 may be included in at least apart of the display 410, and a region occupied by the fingerprint sensor420 may be formed as a portion of the display 410 to extend the size ofthe display.

FIG. 5 is a diagram illustrating a structure in which a fingerprintsensor is built in a display of an electronic device according tovarious embodiments of the disclosure.

With reference to FIG. 5, a structure is illustrated, in which afingerprint sensor 580 is mounted corresponding to at least a part of adisplay provided in front of an electronic device. The electronic devicemay include a glass 510, a touch sensor (e.g., touch detection sensor)530, a display panel 540 (e.g., panel 262 of FIG. 2), a biosensor 580(e.g., biosensor 240I or fingerprint sensor 240N of FIG. 2), and a PCB590. The glass 510 of the electronic device may be attached to the touchsensor 530 or the display panel 540 through adhesives 520. Further, theelectronic device may further include structures 550-1 and 550-2 tosecure a space for mounting the fingerprint sensor 580 therein. Thestructures 550-1 and 550-2 may form at least a part of a sealingstructure for protecting the fingerprint sensor 580.

According to various embodiments, the touch sensor 530 may be formed ona partial region (e.g., one region or a plurality of regions) of thedisplay or the whole region of the display.

According to various embodiments, the touch sensor 530 may be formed onone side of the display panel 540 (e.g., a separate layer 530 on onesurface of the display or at least a partial region of a surface onwhich pixels 541 to 543 of the display panel are formed) to detect auser's touch input. According to various embodiments, the fingerprintsensor 580 may be formed on the other side (e.g., rear side) of thedisplay panel 540. The touch sensor 530 and the fingerprint sensor 580may include, for example, an optical image sensor, an ultrasonictransmission/reception module, or a capacitive transmission/receptionelectrode pattern.

According to various embodiments, the touch sensor 530 may be deployedbetween the adhesives 520 and the display panel 540 or may be deployedbetween the glass 510 and the adhesive layer 520. The touch sensor 530may be formed as a capacitive transmission/reception electrode pattern,and it may be formed as a transparent electrode to heighten permeabilityof light output from the display panel 540.

In the electronic device according to various embodiments, thefingerprint sensor 580 may be deployed on the other side (e.g., rearside) of the display panel 540. Elastic bodies (e.g., sponge or rubber)570-1 and 570-2 for impact mitigation between the fingerprint sensor 580and the display panel 540 or for preventing inflow of foreign substancesmay be formed between the fingerprint sensor 580 and the display panel540. According to various embodiments, the fingerprint sensor 580 mayinclude an image sensor. For example, the image sensor of thefingerprint sensor 580 may detect light (e.g., visible light, infraredray, or ultraviolet ray) that is emitted from a light source (e.g.,display panel 340 or infrared ray (IR) LED) and then is reflected from auser's fingerprint to return to the image sensor. The fingerprint sensor580 may recognize the user's fingerprint based on the light reflectedfrom the user's fingerprint.

FIGS. 6A and 6B are block diagrams of constituent parts of an electronicdevice according to various embodiments of the disclosure.

FIG. 6A illustrates an example of an electronic device 600 (e.g.,electronic device 101 of FIG. 1) according to various embodiments of thedisclosure. According to an embodiment, the electronic device 600 mayinclude at least one processor (e.g., first processor 610 or secondprocessor 620), a memory 630, a display module 640, and at least onesensor 650.

The first processor 610 may control the overall operation of theelectronic device 600. The second processor (e.g., low-power processoror sensor hub) 620 may process sensor information acquired through theat least one sensor 650 or an input acquired from a user without makingthe first processor 610 wake up in the case where the electronic deviceis in a sleep state (e.g., locking mode or inactive state of thedisplay). According to an embodiment, the second processor 620 mayindependently control a biosensor 651, a touch sensor 652, or thedisplay module 640.

According to various embodiments, the electronic device 600 may includethe memory 630, and the memory 630 may include a general region forstoring a user application or the like, or a security region for storingsecurity-sensitive information, such as information for fingerprintsensing.

According to various embodiments, the display module 640 may include adisplay panel 642 including a plurality of pixels and a display drivermodule (e.g., display driver IC (DDI)) 641 configured to provide displayinformation by controlling at least parts of the plurality of pixels toincluded in the display panel 642.

According to various embodiments, the at least one sensor 650 mayinclude the biosensor (e.g., fingerprint sensor) 651 for detecting theuser's fingerprint through the display module 640 or the touch sensor652 for detecting a user's touch. According to various embodiments, thebiosensor 651 may include an optical fingerprint sensor (e.g., imagesensor) that uses light output from the display module 640 as a lightsource. According to various embodiments, the biosensor 651 may use anadditional light source (e.g., IR LED light source (not illustrated)) asthe light source in addition to the light output by the display module.

According to various embodiments, the at least one sensor 650 may drivethe plurality of pixels included in the display panel 642 through thedisplay driver module (DDI) 641 in response to the user's input. Ifnecessary, the at least one sensor 650 may control the display panel642. For example, the biosensor 651 may use the light emitted from thedisplay panel 642 by controlling the display panel 642 to acquire user'sbiometric information (e.g., fingerprint information).

FIG. 6B illustrates another example of an electronic device 600according to various embodiments of the disclosure. According to anembodiment, the electronic device 600 may include a plurality ofcontrollers (e.g., first controller 612, second controller 622, thirdcontroller 643, fourth controller 653, and fifth controller 660). Forexample, the first controller 612 may be included in the first processor610, and the second controller 622 may be included in the secondprocessor 620. Further, the third controller 643 may be included in thedisplay driver module (DDI) 641 of the display module 640. The fourthcontroller 653 may be included in the biosensor 651 of the sensor 650.According to various embodiments, the electronic device 600 may controlthe first processor 610 using the first controller 612, and it maycontrol the second processor 620 using the second controller 622. Theelectronic device 600 may control the display driver module 641 usingthe third controller 643, and it may control the biosensor 651 using thefourth controller 653.

According to various embodiments, the electronic device 600 may controlthe plurality of controllers (e.g., first controller 612, secondcontroller 622, third controller 643, and fourth controller 653) using amain controller (e.g., fifth controller 660). Further, the electronicdevice 600 may designate the main controller, and it may control othercontrollers through the designated main controller. For example, theelectronic device 600 may change/designate the main controller from thefifth controller 660 that is the main controller to the first controller612. The electronic device 600 may control other controllers using thechanged/designated main controller.

According to various embodiments, the electronic device 600 may directlycontrol modules of the electronic device 600 using one controller. Forexample, the electronic device 600 may control the second processor 620,the memory 630, the display module 640, and/or the at least one sensor650 using the first controller 612 included in the first processor 610.According to various embodiments, one controller may control the displaymodule 640 and the at least one sensor 650. For example, in the case ofthe optical fingerprint sensor using the display module 640 as a lightsource, the display module 640 and the at least one sensor 650 may becontrolled by the one controller, and the user's biometric information(e.g., fingerprint information) may be easily acquired.

According to various embodiments of the disclosure, an electronic devicemay include a biosensor; a processor; a display panel including a firstregion corresponding to the biosensor and a touch sensor including asecond region formed at least partly adjacent to at least a part of thefirst region; and one or more control circuits configured to control thetouch sensor, wherein the processor is configured to acquire a user'sinput based on the first region and the second region, identify an inputshape corresponding to the user's input, and acquire biometricinformation corresponding to the user's input through a control of thebiosensor if the identified input shape satisfies a designatedcondition.

According to various embodiments of the disclosure, the processor may beconfigured to satisfy the designated condition if the identified inputshape is detected in the first region, but is not detected in the secondregion.

According to various embodiments of the disclosure, the processor may beconfigured to satisfy the designated condition if the identified inputshape is detected in the first region, and is detected in at least aconfigured part of the second region.

According to various embodiments of the disclosure, the processor may beconfigured to recognize the user's input as a touch input onto the firstregion or the second region if the shape satisfies another designatedcondition.

According to various embodiments of the disclosure, the processor may beconfigured to disregard the user's input in a low-power state.

According to various embodiments of the disclosure, the processor may beconfigured to activate the display panel in a low-power state if theacquired user's input corresponds to a configured pattern or shape, orif a pressure intensity corresponding to the user's input exceeds aconfigured pressure intensity.

According to various embodiments of the disclosure, the processor may beconfigured to activate the biosensor in a low-power state if theacquired user's input corresponds to a configured pattern or shape, orif a pressure intensity corresponding to the user's input exceeds aconfigured pressure intensity.

According to various embodiments of the disclosure, the processor may beconfigured to deactivate the biosensor if the user's input is acquiredthrough an unconfigured part of the second region.

According to various embodiments of the disclosure, the processor may beconfigured to display a notification message or to control and guide thedisplay panel in order for the user's input to satisfy the designatedcondition.

According to various embodiments of the disclosure, the processor may beconfigured to make a light source corresponding to the user's input emitlight and to acquire the biometric information reflected from the user'sinput through the control of the biosensor.

According to various embodiments of the disclosure, the light sourceemitting the light may be a light source of which luminance, a greenvalue, and a red value are adjusted.

According to various embodiments of the disclosure, the processor may beconfigured to compare the acquired biometric information with biometricinformation stored in a memory, and authenticate a user based on theresult of the comparison.

FIG. 7 is a diagram illustrating the structure of main constituent partsof an electronic device according to various embodiments of thedisclosure.

According to various embodiments of the disclosure, a user's fingerprintmay be recognized in a high brightness mode (HBM) that is a mode forvariably adjusting brightness of a display. According to variousembodiments, an electronic device (e.g., electronic device 600 of FIGS.6A and 6B) may detect a user's touch input through a touch screen panel(TSP) (e.g., display panel), and it may activate the HBM if the touchinput satisfies a configured condition. According to variousembodiments, the electronic device 600 may receive pressurecorresponding to the user's touch input through a pressure sensor (forcesensor), and if the pressure satisfies the configured condition, theelectronic device 600 may activate the HBM or the fingerprint sensor.

FIG. 7 schematically illustrates constituent parts corresponding to thedisplay. With reference to FIG. 7, a display (e.g., display module 640of FIGS. 6A and 6B) of the electronic device 600 may include a glass704, a touch screen panel (TSP) 706 deployed below the glass 704, or afingerprint sensor (FPS) 722 (e.g., biosensor 651 of FIGS. 6A and 6B).The electronic device 600 may detect fingerprint informationcorresponding to a user's touch input 702 in the high brightness mode(HBM) through a partial light source 700 of the display. In theelectronic device according to an embodiment of the disclosure, afingerprint recognition region 700 having a size larger than the size ofthe fingerprint sensor 722 may be formed, and the user's fingerprintinformation may be detected based on the fingerprint recognition region700. For example, the electronic device 600 may temporarily emit brightlight based on the fingerprint recognition region 700 in the HBM. Theelectronic device 600 may control the brightness of the light throughdivision of a light emission region into a first region and a secondregion in accordance with the brightness and luminance of the light.

According to various embodiments, the electronic device 600 may emit thelight through configuration of at least one of luminance, and red,green, and blue values to be higher than other values in the HBM. Forexample, if the user's touch is recognized, it may be possible to emitthe light of which the green value is configured to be higher than othervalues. The electronic device 600 may configure high power consumptionin the HBM to make the partial region of the display corresponding tothe fingerprint recognition region 700 emit the light. The emitted lightmay be reflected by the user's fingerprint and it may be transferred tothe fingerprint sensor 722 of the electronic device 600. The electronicdevice 600 may acquire the reflected light through the fingerprintsensor 722, and it may acquire an image corresponding to the user'sfingerprint using the reflected light. The electronic device 600 mayacquire information on the user's fingerprint through analysis of theimage.

According to various embodiments, pressure sensors 734-1 and 734-2 maybe built in the electronic device 600. The electronic device 600 maymeasure pressure 732 generated through the pressure sensors 734-1 and734-2, and if the pressure 732 satisfies a predetermined reference, theelectronic device 600 may activate the HBM. The electronic device 600may measure the intensity of the pressure 732 corresponding to theuser's touch input. If the intensity of the pressure 732 satisfies thepredetermined reference, the electronic device 600 may activate the HBM,and it may acquire the user's fingerprint corresponding to the user'stouch input.

According to various embodiments, if the user's touch input is detected,the electronic device 600 may perform filtering to determine whether theuser's touch input is a user's unintended touch input (false touch). Ifit is determined that the user's touch input is a normal touch input,the electronic device 600 may activate the HBM by controlling thebrightness of the display or the power. The electronic device 600 mayacquire the user's fingerprint corresponding to the user's touch inputin the HBM, and it may perform a user authentication function based onthe acquired fingerprint.

FIG. 8 is a flowchart explaining operations of main constituent parts inthe case where a fingerprint input is detected in a state where adisplay is turned off according to various embodiments of thedisclosure.

With reference to FIG. 8, operations of respective main constituentparts are illustrated corresponding to an operation of activating theHBM in a state where the display is turned off. The main constituentparts illustrated in FIG. 8 may include a touch screen panel (TSP) 810,an application processor (AP) 820, a display driver module (DDI) 830, ora fingerprint sensor (FPS) 840.

At operation 801, the AP 820 may be in a sleep state (e.g., inactivestate). At operation 803, the fingerprint sensor (FPS) 840 may also bein an inactive state. The electronic device may be in a state where thedisplay is turned off. At operation 805, the electronic device maydetect a user's touch input through the TSP 810. If the user's touchinput satisfies a predetermined condition, the electronic device mayactivate the AP 820 and the FPS 840. For example, if the user's touchinput coincides with a predetermined touch pattern or an input shape, orif pressure that is higher than a predetermined pressure is generated,the electronic device may activate the AP 820 and the FPS 840. Atoperation 809, the electronic device may activate the AP 820, and atoperation 807, the electronic device may activate the FPS 840.

If the AP 820 is activated at operation 809, the AP 820, at operation811, may activate a display. Further, if the FPS 840 is activated atoperation 807, the electronic device, at operation 813, may enter into aFPS low-power mode.

At operation 815, the electronic device may activate a high brightnessmode (HBM), and at operation 817, the electronic device may change themode of the FPS 840 from a low-power mode to an active mode. Accordingto various embodiments, the electronic device may acquire user'sfingerprint information corresponding to the user's touch input in theHBM, and it may perform a user authentication function based on thefingerprint information. At operation 819, the electronic device maycapture the user's fingerprint information corresponding to the user'stouch input through the FPS 840. After capturing the user's fingerprintinformation, the electronic device, at operation 823, may deactivate theHBM by controlling the DDI 830. According to various embodiments, evenif the user's touch input is released at operation 821, the electronicdevice may deactivate the HBM by controlling the DDI 830.

At operation 825, the electronic device may compare the captured user'sfingerprint information with fingerprint information stored in thememory, and it may notify the user of the result of the comparison. Forexample, if the user's fingerprint information coincides with the storedfingerprint information, the electronic device, at operation 827, maydisplay a configured user interface (UI). If the user's fingerprintinformation does not coincide with the stored fingerprint information,the electronic device may provide an authentication error message to theuser. According to various embodiments, in accordance with thecompletion of the user authentication, the electronic device may releasethe locking function of the electronic device, or it may perform aconfigured application function.

FIG. 9 is a flowchart explaining operations of main constituent parts inthe case where a fingerprint input is detected in a state where adisplay is turned on according to various embodiments of the disclosure.

With reference to FIG. 9, in a state where the display is turned on, theAP 820 of FIG. 8 may be maintained in an active state, and the AP 820may be omitted.

At operation 901, the electronic device may maintain a state where thedisplay is turned on by controlling the DDI 830. At operation 903, theFPS 903 may be in an inactive state. At operation 905, the electronicdevice may detect the user's touch input through the TSP 810. Forexample, the electronic device may identify an input shape correspondingto the detected user's touch input, and it may determine whether theinput shape coincides with a configured input shape. If the input shapecoincides with the configured input shape, the electronic device, atoperation 907, may activate the FPS 840. At operation 909, theelectronic device may activate an FPS low-power mode.

At operation 911, the electronic device may activate the HBM bycontrolling the DDI 830, and at operation 913, the electronic device maychange the mode of the FPS 840 from a low-power mode to an active mode.According to various embodiments, the electronic device may acquireuser's fingerprint information corresponding to the user's touch inputin the HBM. At operation 915, the electronic device may capture theuser's fingerprint information corresponding to the user's touch inputthrough the FPS 840. After capturing the user's fingerprint information,the electronic device, at operation 917, may deactivate the HBM bycontrolling the DDI 830. According to various embodiments, even if theuser's touch input is released at operation 919, the electronic devicemay deactivate the HBM by controlling the DDI 830.

At operation 921, the electronic device may compare the captured user'sfingerprint information with fingerprint information stored in thememory, and it may notify the user of the result of the comparison. Forexample, if the user's fingerprint information coincides with the storedfingerprint information, the electronic device, at operation 923, maydisplay a configured user interface. If the user's fingerprintinformation does not coincide with the stored fingerprint information,the electronic device may provide an authentication error message to theuser.

FIG. 10 is a flowchart explaining an operation of detecting afingerprint input based on a touch pressure in a state where a displayis turned on according to various embodiments of the disclosure.

With reference to FIG. 10, the TSP 810 illustrated in FIG. 9 is omitted,and a pressure sensor 850 is illustrated. In FIG. 10, it may be possibleto measure a pressure intensity corresponding to the user's touch inputbased on the pressure sensor 850, and to activate the high brightnessmode (HBM) if the pressure intensity satisfies a predeterminedcondition.

Operations 1001 and 1003 correspond to operations 901 and 903 of FIG. 9.At operation 1005, the electronic device may measure the pressureintensity of the user's touch input using the pressure sensor 850. Ifthe measured pressure intensity exceeds a predetermined pressureintensity value (if the measured pressure intensity satisfies thepredetermined condition), the electronic device, at operation 1007, mayactivate the FPS 840.

Operations 1007 to 1017 correspond to operations 907 to 917 of FIG. 9.At operation 1019, the electronic device may identify whether thepressure intensity of the user's touch input is lower than thepredetermined pressure intensity value using the pressure sensor 850. Ifthe pressure intensity is lower than the predetermined pressureintensity value, the electronic device, at operation 1017, maydeactivate the HBM. According to various embodiments, the electronicdevice may determine whether to activate the HBM corresponding to thepressure intensity of the user's touch input.

At operation 1021, the electronic device may compare the user'sfingerprint information captured at operation 1015 with the fingerprintinformation stored in the memory, and it may notify the user of theresult of the comparison. For example, if the user's fingerprintinformation coincides with the stored fingerprint information, theelectronic device, at operation 1023, may display a configured userinterface. If the user's fingerprint information does not coincide withthe stored fingerprint information, the electronic device may provide anauthentication error message to the user.

The electronic device according to various embodiments may measure thepressure intensity corresponding to the user's touch input through thepressure sensor 850, and if the pressure intensity exceeds thepredetermined pressure intensity value, the electronic device mayactivate the HBM or the fingerprint sensor. The pressure sensor 850according to various embodiments may detect the pressure in an always onstate, or the pressure sensor may be activated by the TSP (notillustrated) 810 to measure the pressure intensity corresponding to theuser's input.

FIG. 11 is a flowchart explaining a method for recognizing a fingerprintusing a fingerprint sensor associated with a display according tovarious embodiments of the disclosure.

At operation 1101, a processor (e.g., first processor 610 or secondprocessor 620 of FIG. 6A) of an electronic device (e.g., electronicdevice 600 of FIG. 6A) may detect a user's touch input or it may measurea pressure intensity corresponding to the user's touch input. Forexample, the electronic device 600 may detect a touch patterncorresponding to the touch input, a touch location, or an input shape.The input shape may be a specific shape corresponding to the user'stouch input. Hereinafter, although it is described that the electronicdevice 600 is controlled by the first processor 610, the electronicdevice 600 may be controlled by the second processor 620 in a low-powermode (e.g., locking mode, sleep mode, or display inactive mode).

At operation 1103, the electronic device 600 (e.g., first processor 610or second processor 620) may identify whether the touch input is a falsetouch input (e.g., user's unintended touch input). For example, theelectronic device 600 may determine and form a partial region of thedisplay (e.g., display module 640) as a fingerprint recognition regionfor recognizing a user's fingerprint. The processor (e.g., firstprocessor 610 or second processor 620, hereinafter, the processor isdescribed as the first processor 610) of the electronic device 600 mayidentify whether the user's touch input is the false touch input basedon the formed fingerprint recognition region. Further, the firstprocessor 610 of the electronic device 600 may determine and form afingerprint error region for determining that the user's touch input isfalse corresponding to a partial region of the display. The firstprocessor 610 may determine the fingerprint error region based on thefingerprint recognition region. The first processor 610 may identifythat the user's touch input is false based on the formed fingerprinterror region. The fingerprint recognition region and the fingerprinterror region may be formed adjacent to each other, and the firstprocessor 610 may determine the user's touch input that deviates fromthe fingerprint error region as the false touch input. If it isdetermined that the user's touch input is the false touch input, thefirst processor 610, at operation 1115, may perform another function.For example, the first processor 610 may provide a notification messagefor notifying that the touch input is false to the user. Thenotification message may include a popup message, a voice message,signal sound, brightness change, and vibration. For example, if thetouch input is false, the electronic device 600 may perform a generaltouch function without performing the fingerprint recognition operation,or it may perform UI control or function control corresponding to anapplication. According to an embodiment, the electronic device, atoperation 1101, may identify a direction, pressure, or location of thetouch in order to determine whether the user's touch input is a user'sunintended touch input (false touch).

If the user's touch input is a correct touch input (e.g., touch inputfor fingerprint recognition) at operation 1103, the electronic device600 (e.g., first processor 610 or second processor 620) may activate thehigh brightness mode (HBM) at operation 1105. For example, the firstprocessor 610 may activate the HBM based on the fingerprint recognitionregion. The first processor 610 may acquire the user's fingerprint inthe HBM. The first processor 610 may adjust the brightness of a partialregion of the display in the HBM, or it may control the display so thata light source emits light around the green or red value. According toan embodiment of the disclosure, the electronic device may control toheighten the luminance of the partial region of the display or toheighten the power applied to the partial region of the display in theHBM. The first processor 610 may acquire the user's fingerprint bycontrolling the light source.

At operation 1107, the first processor 610 may acquire the user's touchinput based on the fingerprint recognition region, and it may acquirethe user's fingerprint corresponding to the user's touch input. Atoperation 1109, the first processor 610 may perform a fingerprintauthentication function based on the acquired user's fingerprint. Forexample, the first processor 610 may acquire the user's fingerprint in astate where the user's fingerprint information is stored in the memory(e.g., memory 630 of FIG. 6A). The first processor 610 may perform thefingerprint authentication function through comparison of the acquireduser's fingerprint with the fingerprint information stored in the memory630. After performing the fingerprint authentication function, the firstprocessor 610, at operation 1111, may deactivate the HBM.

According to another embodiment, at operation 1113, the first processor610 may determine whether the user's touch input is released (ended).For example, if the touch input is released, the first processor 610, atoperation 1111, may deactivate the activated HBM. If the touch input isnot released, the first processor 610 may perform the fingerprintauthentication function through acquisition of the user's fingerprint ina state where the HBM is activated.

According to various embodiments, in a low-power mode (e.g., lockingmode, sleep mode, or display inactive mode), the operations illustratedin FIG. 11 may be controlled by the second processor 620.

FIG. 12 is a diagram illustrating a fingerprint recognition regionformed corresponding to a partial region of a display according tovarious embodiments of the disclosure.

FIG. 12 illustrates a display 1210 of an electronic device. Withreference to FIG. 12, the electronic device 600 may include afingerprint sensor (FPS) 1230 corresponding to a part of the display1210 (e.g., 410 of FIG. 4). The fingerprint sensor 1230 may be deployedon a lower end portion of the display 1210. The fingerprint sensor 1230may be provided in the form of a rectangle having a vertical length1230-1 and a horizontal length 1230-2, but it is not limited thereto. Ifthe HBM is activated, the electronic device 600 according to variousembodiments may form a fingerprint recognition region (HBM region) 1220(e.g., 420 of FIG. 4) based on the fingerprint sensor 1230. Thefingerprint recognition region 1220 may be formed adjacent to thefingerprint sensor 1230 based on the size of the fingerprint sensor1230, and it may be formed to be larger than the fingerprint sensor1230. For example, the fingerprint recognition region 1220 may be formedto have horizontal and vertical lengths 1220-1 and 1220-2 that are 1 to2 mm larger than those of the fingerprint sensor 1230. The fingerprintrecognition region 1220 may be a region in which the electronic device600 can detect the user's touch input. With reference to FIG. 12, thefingerprint recognition region 1220 may be formed in a rectangular shapehaving a vertical length 1220-1 and a horizontal length 1220-2, but itis not limited thereto.

FIG. 13 is a diagram illustrating a process of detecting a user's inputbased on a fingerprint recognition region according to variousembodiments of the disclosure.

With reference to FIG. 13, an electronic device may include afingerprint sensor 1320 corresponding to a part of a display 1310, andit may detect user's touch input 1305 based on the fingerprint sensor.The electronic device may determine a fingerprint recognition region1303 based on the user's touch input 1305. The electronic deviceaccording to various embodiments may variably change the fingerprintrecognition region based on the user's touch input. For example, theelectronic device may variably configure the fingerprint recognitionregion 1303 corresponding to the user's touch input 1305, and it maycontrol to change the fingerprint recognition region 1303 correspondingto the change of the user's touch input 1305.

FIG. 14 is a diagram illustrating a process of recognizing a user'sfingerprint according to various embodiments of the disclosure.

With reference to FIG. 14, an electronic device 600 may detect a user'stouch input 1403 based on a panel (e.g., panel 642 of FIG. 6A) of adisplay module (display module 640 of FIG. 6A). For example, theelectronic device 600 may identify the user's touch input 1403 based onpoints 1410-1, 1410-2, 1410-3, and 1410-5 at which the user's touchinput is detected on the panel and points 1410-4 and 1410-6 at which theuser's touch input is not detected. The electronic device 600 accordingto various embodiments may configure a partial region of a display as afingerprint recognition region 1410 corresponding to the identifieduser's touch input 1403. The electronic device 600 may acquire an imagecorresponding to a user's fingerprint with respect to the user's touchinput 1403 through a fingerprint sensor 1420. The electronic device 600according to various embodiments may identify the user's fingerprintthrough comparison of the acquired image with fingerprint informationstored in a memory.

According to an embodiment of the disclosure, if a high brightness mode(HBM) that is a mode for variably adjusting the brightness of thedisplay is activated, the electronic device 600 may determine a HBMtarget region (e.g., fingerprint recognition region) 1401. For example,the HBM target region 1401 may be processed to be bright on the display,and the remaining region may be processed to be dark in comparison withthe HBM target region 1401. According to an embodiment of thedisclosure, the processing of the HBM target region 1401 is not limitedto the HBM, but the processing of the HBM target region 1401 may beperformed based on various factors, such as color, luminance, andapplied power.

FIG. 15 is a diagram illustrating a fingerprint recognition region and afingerprint error region according to various embodiments of thedisclosure.

With reference to FIG. 15, an electronic device may include afingerprint sensor 1530 corresponding to a part of a display 1510, andit may determine a fingerprint recognition region 1530 based on thefingerprint sensor 1530. The electronic device may form a fingerprinterror region 1540 in an outer region based on the fingerprintrecognition region 1530. The electronic device according to variousembodiments may determine a false touch (e.g., false touch input orabnormal touch input occurring through a touch of another body part thatis not a user's fingerprint) based on the fingerprint error region 1540.The electronic device according to various embodiments may make a lightsource for fingerprint sensing emit light corresponding to thefingerprint recognition region 1530.

In the electronic device according to various embodiments, thefingerprint error region (e.g., false touch prevention guide region)1540 may be formed adjacent to an outside of the fingerprint recognitionregion 1530. If the user's touch input occurs corresponding to thefingerprint error region 1540, the electronic device according tovarious embodiments may determine that the touch input is an abnormaltouch input, and it may not perform the fingerprint sensing function.The electronic device may not perform the fingerprint sensing function,or it may not activate the fingerprint sensor 1530. The electronicdevice according to various embodiments may determine whether the user'stouch input is normal based on configured angle, location, direction andshape.

FIG. 16 is a diagram illustrating a process of recognizing a fingerprintbased on a fingerprint recognition region and a fingerprint error regionaccording to various embodiments of the disclosure.

With reference to FIG. 16, an electronic device may determine whether auser's touch input is a user's unintended touch input (false input)based on the fingerprint recognition region 1530 and the fingerprinterror region (e.g., false touch prevention guide region) 1540. Forexample, if a user's first touch input 1610 occurs through a partialregion of the fingerprint error region 1540, the electronic device maydetermine that the user's touch input does not correspond to the user'sunintended touch input, and it may perform a user authenticationfunction. In contrast, if a user's second touch input 1620 occursthrough the partial region of the fingerprint error region 1540, theelectronic device may determine that the user's touch input is theuser's unintended touch input, and it may not perform the userauthentication function. The electronic device may determine that theuser's touch input is not the user's unintended touch input only withrespect to the user's touch input through a lower end portion of thefingerprint error region 1540. Further, if the touch does not occurcorresponding to the fingerprint error region 1540, but the touch inputcorresponding to the fingerprint recognition region 1530 occurs, theelectronic device may determine that the touch input is a normal touchinput.

The electronic device according to various embodiments may determine thefingerprint error region 1540 corresponding to the fingerprintrecognition region 1530, and it may except parts (e.g., upper end part,lower end part, left part, and right part) of the fingerprint errorregion 1540 from the fingerprint error region 1540.

The electronic device according to various embodiments may determinewhether the user's touch input is the user's unintended touch inputbased on the fingerprint recognition region 1530 and the fingerprinterror region 1540, and if the user's touch input is not the user'sunintended touch input, the electronic device may perform the userauthentication function based on the user's fingerprint corresponding tothe user's touch input.

According to various embodiments of the disclosure, a method forcontrolling a biosensor associated with a display may include acquiringa user's input based on a first region corresponding to the biosensorand a second region corresponding to a touch sensor and adjacent to atleast a part of the first region; identifying an input shapecorresponding to the user's input; and acquiring biometric informationcorresponding to the user's input through a control of the biosensor ifthe identified input shape satisfies a designated condition.

According to various embodiments of the disclosure, the method mayfurther include satisfying the designated condition if the identifiedinput shape is detected in the first region, but is not detected in thesecond region.

According to various embodiments of the disclosure, the method mayfurther include satisfying the designated condition if the identifiedinput shape is detected in the first region, and is detected in at leasta configured part of the second region.

According to various embodiments of the disclosure, the method mayfurther include recognizing the user's input as a touch input onto thefirst region or the second region if the shape satisfies anotherdesignated condition.

According to various embodiments of the disclosure, the method mayfurther include activating the display panel in a low-power state if theacquired user's input corresponds to a configured pattern or shape, orif a pressure intensity corresponding to the user's input exceeds aconfigured pressure intensity.

According to various embodiments of the disclosure, the method mayfurther include activating the biosensor in a low-power state if theacquired user's input corresponds to a configured pattern or shape, orif a pressure intensity corresponding to the user's input exceeds aconfigured pressure intensity.

According to various embodiments of the disclosure, the method mayfurther include deactivating the biosensor if the user's input isacquired through an unconfigured part of the second region.

According to various embodiments of the disclosure, the method mayfurther include displaying a notification message or controlling andguiding the display panel in order for the user's input to satisfy thedesignated condition.

According to various embodiments of the disclosure, acquiring thebiometric information may include making a light source corresponding tothe user's input emit light, and acquiring the biometric informationreflected from the user's input through the control of the biosensor.

According to various embodiments of the disclosure, the method mayfurther include comparing the acquired biometric information withbiometric information stored in a memory, and authenticating a userbased on the result of the comparison.

The term “module” as used herein may include a unit consisting ofhardware, software, or firmware, and may, for example, be usedinterchangeably with the term “logic”, “logical block”, “component”,“circuit”, or the like. The “module” may be an integrated component or aminimum unit for performing one or more functions or a part thereof. The“module” may be implemented mechanically or electronically, and mayinclude, for example, an Application-Specific Integrated Circuit (ASIC)chip, a Field-Programmable Gate Array (FPGA), or a programmable logicdevice, which is known or is to be developed in the future, forperforming certain operations. At least some of devices (e.g., modulesor functions thereof) or methods (e.g., operations) according to variousembodiments may be implemented as instructions which are stored acomputer-readable storage medium (e.g., the memory 130) in the form of aprogram module. If the instructions are executed by a processor, theprocessor may perform a function corresponding to the instructions. Thecomputer-readable storage medium may include a hard disk, a floppy disk,a magnetic medium (e.g., a magnetic tape), optical media (e.g., CD-ROM,DVD), magneto-optical media (e.g., a floptical disk), internal memory,etc. The instructions may include code compiled by a complier or codethat can be executed by an interpreter. The programming module accordingto the present disclosure may include one or more of the aforementionedcomponents or may further include other additional components, or someof the aforementioned components may be omitted. Operations performed bya module, a programming module, or other elements according to variousembodiments may be executed sequentially, in parallel, repeatedly, or ina heuristic manner. At least some operations may be executed accordingto another sequence, may be omitted, or may further include otheroperations.

1. A portable communication device comprising: a touch sensor; afingerprint sensor; a display electrically coupled with the touch sensorand the fingerprint sensor, the display including: a first area capableof sensing a fingerprint using the fingerprint sensor, the first areaincluding a portion under which the fingerprint sensor is located; and asecond area incapable of sensing the fingerprint; and a processorelectrically coupled with the touch sensor, the display and thefingerprint sensor, wherein the processor is configured to: while thefingerprint sensor is deactivated, detect a touch input using the touchsensor, identify a type of the touch input, the identifying includingdetermining the type as a first type when the touch input being detectedwithin the first area corresponds to a configured shape, and determiningthe type as a second type when the touch input being detected within thedisplay does not correspond to the configured shape, based at least inpart on the determining that the type is the first type, activate thefingerprint sensor and perform one or more functions corresponding tothe touch input based on the activated fingerprint sensor, and based atleast in part on the determining that the type is the second type,perform a touch function corresponding to the touch input withouttriggering an activation of the fingerprint senor.
 2. The portablecommunication device of claim 1, wherein the processor is configured to:control, in response to the determining that the type is the first type,the display to operate in a high brightness mode with respect to thefirst area such that a fingerprint image is captured using thefingerprint sensor while the display is operated in the high brightnessmode.
 3. The portable communication device of claim 2, wherein theprocessor is configured to: perform authentication of the fingerprintbased at least in part on the fingerprint image captured while thedisplay is operated in the high brightness mode.
 4. The portablecommunication device of the claim 3, wherein the processor is configuredto: while the fingerprint sensor is activated and the display isoperated in the high brightness mode, determine whether the touch inputsatisfies a designated condition, and perform, in response to satisfyingthe designated condition, the authentication of the fingerprint.
 5. Theportable communication device of the claim 4, wherein the designatedcondition include a condition that the user input corresponds to atleast one of a configured pattern or a configured shape or a pressureintensity of the user input exceeds a configured pressure intensity. 6.The portable communication device of the claim 4, wherein the processoris configured to: deactivate, in response to dissatisfying thedesignated condition, the fingerprint sensor without performing theauthentication.
 7. The portable communication device of the claim 1,wherein the processor is configured to: control, in response to thedetermining that the type is the first type, the display so that thefirst area is displayed brighter than the second area, and capture afingerprint image corresponding to the touch input based on the firstarea.
 8. The portable communication device of the claim 1, wherein theprocessor is configured to: control, in response to the determining thatthe type is the second type, the display to refrain in a high brightnessmode with respect to the second area.
 9. The portable communicationdevice of claim 1, wherein the first area is substantially surrounded bythe second area.
 10. The portable communication device of the claim 1,wherein the processor is configured to: control, in response to thedetermining that the type is the second type, the display to display anindication guiding a user to provide another touch input within thesecond area.
 11. A method comprising: detecting a touch input on adisplay using a touch sensor, while a fingerprint sensor is deactivated;identifying a type of the touch input, the identifying includingdetermining the type as a first type when the touch input being detectedwithin a first area corresponds to a configured shape, and determiningthe type as a second type when the touch input being detected within thedisplay does not correspond to the configured shape; based at least inpart on the determining that the type is the first type, activating thefingerprint sensor and performing one or more functions corresponding tothe touch input based on the activated fingerprint sensor; and based atleast in part on the determining that the type is the second type,performing a touch function corresponding to the touch input withouttriggering an activation of the fingerprint senor.
 12. The method ofclaim 11, further comprising: controlling, in response to thedetermining that the type is the first type, the display to operate in ahigh brightness mode with respect to the first area such that afingerprint image is captured using the fingerprint sensor while thedisplay is operated in the high brightness mode.
 13. The method of claim12, further comprising: performing authentication of a fingerprint basedat least in part on the fingerprint image captured while the display isoperated in the high brightness mode.
 14. The method of claim 13,further comprising: while the fingerprint sensor is activated and thedisplay is operated in the high brightness mode, determining whether thetouch input satisfies a designated condition; and performing, inresponse to satisfying the designated condition, the authentication ofthe fingerprint.
 15. The method of claim 14, wherein the designatedcondition include a condition that the user input corresponds to atleast one of a configured pattern or a configured shape or a pressureintensity of the user input exceeds a configured pressure intensity. 16.The method of claim 14, further comprising: deactivating, in response todissatisfying the designated condition, the fingerprint sensor withoutperforming the authentication.
 17. The method of claim 11, furthercomprising: controlling, in response to the determining that the type isthe first type, the display so that the first area capable of sensing afingerprint is displayed brighter than a second area incapable ofsensing the fingerprint; and capturing a fingerprint image correspondingto the touch input based on the first area.
 18. The method of claim 11,further comprising: controlling, in response to the determining that thetype is the second type, the display to refrain in a high brightnessmode with respect to a second area incapable of sensing a fingerprint.19. The method of claim 11, wherein the first area capable of sensing afingerprint is substantially surrounded by a second area incapable ofsensing the fingerprint.
 20. The method of claim 11, further comprising:controlling, in response to the determining that the type is the secondtype, the display to display an indication guiding a user to provideanother touch input within a second area.